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1 Introduction 


We consider the following composite convex minimization problem. 

Problem 1.1 Let and be reflexive real Banach spaces, let ip e r 0 (5T), let xp e r 0 i^) be Gateaux 
differentiable on int dom xp ^ 0, and let L: 3C — * <3/ be a bounded linear operator. The problem is to 

minimize ip(x) + ip(Lx). (1.1) 

The set of solutions to (1.1) is denoted by S. 

A particular instance of (1.1) is when xp = D s f, r), where g e T 0 (S^) is Gateaux differentiable on 
int domg 3 r, i.e., 

minimize p(x) + D s (Lx, r). (1.2) 

xest r 

This model provides a framework for many problems arising in applied mathematics. For instance, 
when and 3/ are Euclidean spaces and g is Boltzmann-Shannon entropy, it captures many problems 
in information theory and signal recovery [10], Besides, the nearness matrix problem [20] and the 
log-determinant minimization problem [14] can be also regarded as special cases of (1.2). 

An objective is constructing effective splitting methods, i.e, the methods that activate each function 
in the model separately, to solve Problem 1.1 (see [18] for more discussions). It was shown in [18] 
that if 3C and 3/ are Hilbert spaces and if xp possess a /^-Lipschitz continuous gradient for some 
/3 € ] 0, +oo[, then Problem 1.1 can be solved by the standard forward-backward algorithm 

(VneN) x n+1 =prox rnV (x n -y n L*(V'0(Lx n ))), where 0<y n <2/3. (1.3) 

Here, (prox^)„ eN are the Moreau proximity operators [24]. However, many problems in applica¬ 
tions do not conform to these hypotheses, for example when and 3/ are Euclidean spaces and xp 
is Boltzmann-Shannon entropy. This type of functions appears in many problems in image and signal 
processing, in statistics, and in machine learning [2, 13, 14, 21, 22, 23]. Another difficulty in the im¬ 
plementation of (1.3) is that the operators (prox,,^) ne[; are not always easy to evaluate. The objective 
of the present paper is to propose a version of the forward-backward splitting algorithm to solve Prob¬ 
lem 1.1, which is so far limited to Hilbert spaces, in the general framework of reflexive real Banach 
spaces. This algorithm, which employs Bregman distance-based proximity operators, provides new 
algorithms in the framework of Euclidean spaces, which are, in some instances, more favorable than 
the standard forward-backward splitting algorithm. This framework can be applied in the case when 
xp is not everywhere differentiable and in some instances, it requires less efforts in the computation of 
proximity operators than the classical framework. This paper revolves around the following definitions. 

Definition 1.2 [5, 6] Let 3C be a reflexive real Banach space, let 3C* be the topological dual space of 3C, 
let (•, •) be the duality pairing between 3C and 3C*, let f \ 3C —* ]—oo, +oo] be a lower semicontinuous 
convex function that is Gateaux differentiable on int dom/ ^ 0, let /*: —> ]—oo,+ 00 ] : x* *-» 

sup xear ((x, x*) — fix')) be conjugate of/, and let 

df:3£—> 2 X *: x >-» {x* e I (Vy e X) (y - x,x*) +/(x) /(y)}, (1.4) 
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be the Moreau subdifferential of /. The Bregman distance associated with / is 


D f : 3L x3L 

(x,y) 


[0, +oo] 

I f O) - f(y) -(x-y, V/(y)), if y e int dom/; 
1 +oo, otherwise. 


(1.5) 


In addition, / is a Legendre function if it is essentially smooth in the sense that df is both locally bounded 
and single-valued on its domain, and essentially strictly convex in the sense that df* is locally bounded 
on its domain and / is strictly convex on every convex subset of dom df. Let C be a closed convex 
subset of 3L such that C n int dom/ / 0. The Bregman projector onto C induced by / is 


P'c : int dom/ —* C IT int dom/ 

y argmin D-^ (x,y), 

xeC 

and the D?-distance to C is the function 
: 3L —» [0, +00] 
y -»inf D^(C,y). 


( 1 . 6 ) 


(1.7) 


The paper is organized as follows. In Section 2, we provide some preliminary results. We present 
the forward-backward splitting algorithm in reflexive Banach spaces in Section 3. Section 4 is devoted 
to an application of our result to multivariate minimization problem together with examples. 

Notation and background. The norm of a Banach space is denoted by || • ||. The symbols —* and 
—» represent respectively weak and strong convergence. The set of weak sequential cluster points 
of a sequence (x„) neN is denoted by 2B(x n ) ngN . Let M: 3L —> 2 a . The domain of M is domM = 
{x € SC | Mx 7 ^ 0} and the range of M is ranM = {x* e 3L* | (]xe3T)x*e Mx}. Let /: —* 

]— 00 ,+ 00 ]. Then/ is cofinite if dom/* = 9£*, is coercive if lim|| x ||_, + 00 /(x) = + 00 , is supercoercive if 
lim|| x ||_ >+ 00 /(x)/||x|[ = + 00 , and is uniformly convex at x e dom/ if there exists an increasing function 
<p : [0, +00 [ —» [0, + 00 ] that vanishes only at 0 such that 

(Vy Gdom/)(Va e ]0,1[) /(ax + (1 - a)y) + a(l - a)/(||x — y |[) ^ a/(x) + (l - a)/(y). (1.8) 

Denote by F 0 (3L) the class of all lower semicontinuous convex functions / : 3L —* ]— 00 , + 00 ] such that 
dom/ = {x e 3C | /(x) < + 00 } 7 ^ 0. Let / e T 0 (3T). The set of global minimizers of / is denoted by 
Argmin/. Finally, £i(N) is the set of all summable sequences in [0, +oo[. 


2 Preminarily results 


First, we recall the following definitions and results. 

Definition 2.1 [25] Let f be a reflexive real Banach space and let / e be Gateaux differen¬ 

tiable on int dom/ / 0. Then 

3~(f) = {g e r 0 (ar) g is Gateaux differentiable on int domg = int dom/}. (2.1) 
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Moreover, if g 1 and g 2 are in r J(f ), then 


gi 5 = g 2 (Vx G dom/)(Vy G int dom/) D Sl (x,y) ^ D g2 (x,y). 


( 2 . 2 ) 


For every a G [0, +oo[, set 

3 5 a(/) = {g e 3'(/) I g ^«/}- 


(2.3) 


Definition 2.2 [25] Let 3T be a reflexive real Banach space, let / G r 0 (iF) be Gateaux differentiable 
on int dom/ 7 ^ 0, let (/ n ) nS ^ be in 3“(/), let (x n ) neN G (intdom/) N , and let C c SC be such that 
C n dom/ 7 ^ 0. Then (x n ) n6N is: 

(i) quasi-Bregman monotone with respect to C relative to (/ n )„ eI j if 

(3(i)n)„ eN S f+(N))(Vx e C n dom/)(3(e n ) neN g (+(N))(Vn G N) 

D /n+ 1 (x,x n+1 ) ^ (1 + p n )D /n (x,x n ) + (2.4) 

(ii) stationarily quasi-Bregman monotone with respect to C relative to if 

(3( e JneN e e f+ (N))(Vx G C n dom/)(Vn G N) 

D fn+1 (x, x„ +1 ) ^ (1 + ri n )D fn {x, xj + (2.5) 

Condition 2.3 [6, Condition 4.4] Let iibea reflexive real Banach space and let / G T 0 (^) be Gateaux 
differentiable on int dom/ / 0. For every bounded sequences (x n )„ 6N and (y n ) ne;: in int dom/, 

D f (x n , y n ) -» 0 => x n — y n —> 0 . ( 2 . 6 ) 

Proposition 2.4 [25] Let 3L be a reflexive real Banach space, let f G r 0 (3T) be Gateaux differentiable on 
int dom/ 0, let a G ]0,+oo[, let (/ n ) ne n * n (P a (/X let ( x n)neN e (intdom/) N , let C a 3L be such 
that C n int dom/ 7 ^ 0, and let x £ C fl int dom/. Suppose that (x n ) nsN is quasi-Bregman monotone with 
respect to C relative to (/„) neN . Then the following hold. 

(i) (D / -(x,x n )) neN converges. 

(ii) Suppose that D? (x, •) is coercive. Then (x n )„ £N is bounded. 

Proposition 2.5 [25] Let 3L be a reflexive real Banach space, let f G r 0 (3L ) be Gateaux differentiable on 
int dom/ 7 ^ 0, let (x n ) nsN G (int dom/) N , let C c 3G be such that C flint dom/ 7 ^ 0, let (i 7 „) ne pj e f+(N), 
let a G ]0,+oo[, and let (/ n ) ne pj in (P a (/) be sncb that (Vn G N) (1 + rj n )/„ £= / n+1 . Suppose that (x„) neN 
is quasi-Bregman monotone with respect to C relative to (/ n ) n£ pj, that there exists g G 3“(/) sncb that for 
every n G N, g 5 = / n , and that, for every y 1 G ^ and every y 2 e iF, 

Jt e 2U(x„) neN n C 



t «yi - y 2 > v /n(x n )))„ eN converges 

Moreover, suppose that (Vx G int dom/) D f (x, •) is coercive. Then (x n ) neN converges weakly to a point in 
C fl int dom/ if and only if 2U(x n ) neN c C n int dom/. 
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Proposition 2.6 [25] Let 3T be a reflexive real Banach space, let f e T 0 (3C) be a Legendre function, let 
a e ]0, +00 [, let (/„) neN be in T a (/), let (x„) neN e (int dom/) N , and Zet C be a closed convex subset of 3T 
such that C fl int dom/ 7 ^ 0. Suppose that (x n )„ 6N is stationarily quasi-Bregman monotone with respect 
to C relative to (f n ) ne ^, that f satisfies Condition 2.3, and that (Vx e int dom/) D^(x, •) is coercive. In 
addition, suppose that there exists f e ]0, +oo[ such that (Vn e N) j 8 / $= f n . Then (x n ) neN converges 
strongly to a point in C C dom f if and only iflimD[(x„) = 0. 

We discuss some basic properties of a type of Bregman distance-based proximity operators in the 
following proposition. 

Proposition 2.7 Let 3C be a reflexive real Banach space, let f e r o(3C') be Gateaux differentiable on 
int dom/ 7 ^ 0 , let ip e F 0 [3C), and let 

Proxf : X* — 2 X 

1 , ( 2 . 8 ) 

x* >-* {x e X | t/>(x) +/(x) — (x, x*) = min (</?+/ — x*)($T) < + 00 } 
be /-proximity operator of ip. Then the following hold. 

(i) ranProx^, c dom/ fldom;/? and Prox^, = (3(/ + t/?)) _1 . 

(ii) Suppose that dom ;/? fl int dom/ 7 ^ 0 and that dom df n dom dip c int dom/. Then the following 

hold. 

(a) ranProx^, c int dom/ and Prox^, = (V/ + dip ) _1 . 

(b) int (dom/* + dom;/?*) c domProx^,. 

(c) Suppose that f | int dom/ strictly convex. Then Prox^, is single-valued on its domain. 

Proof. Let us fix x* e X* and define f x *: X —» ]— 00 ,+ 00 ] : x >-» /(x) — (x,x*) +/*(x*). Then 
dom f x * — dom/ and ip + f x * € T 0 (X). Moreover, 3(i/? + f x *) = d(<p +/) — x*. 

(i) : By definition, ranProx^ c dom/ fl dom;/?. Suppose that dom/ fl dom;/? 7 ^ 0 and let x e 
dom/ fl dom ip. Then 

x e Prox^x* <=> 0 € <?(</? + / X *)M 

<=> 0 € d{ip +/)(x) — x* 

<=>x*e3(i/+ /)(x) 

<^x€(d( V +/))- 1 (x*). (2.9) 

(ii) : Suppose that x* e int(dom/* + dom;/?*). Since dom;/? fl int dom/ 7 ^ 0, it follows from [1, 
Theorem 1.1] and [28, Theorem 2.1.3(ix)] that 

x* e int (dom/* + dom^?*) = int dom (/ + ip)*. ( 2 . 10 ) 
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(ii)(a): Since dom</? n intdom/ 7 ^ 0, d{p + /) = dp + df by [1, Corollary 2.1], and hence (i) 
yields 


ranProx^. = dom3(/ + p) = dom(3/ + dp) = dom df C\domdp c intdom/. (2.11) 

In turn, ranProx^, c dom p flint dom/. We now prove that Prox^, = (V/ + 3 p)~ l . Note that dom(V/ + 
dp) c domi/) n int dom/. Let x G dom c p n int dom/. Then 3(/ + c^)(x) = 3/(x) + dp(x) = V/(x) + 
dip(x) and therefore, 

x g Prox-^x* «x*e3(/ + i/?)(x) = V/(x) + dp(x) <=> x g (V/ + 3i/p)” 1 (x*). (2.12) 

(ii)(b): We derive from (2.10) and [5, Fact 3.1] that <p + f x * is coercive. Hence, by [28, Theo¬ 
rem 2.5.1], ip + f x * admits at least one minimizer, i.e., x* G domProx^,. 

(ii)(c) : Since /[ intdom/ is strictly convex, so is (p + f x *) | intd0 m/ and thus, in view of (ii)(b) , ip + f x * 
admits a unique minimizer on int dom/. However, since 

Argmin (p + f x *) = ranProx--' c int dom/, (2.13) 

it follows that p + f x * admits a unique minimizer and that Prox^ is therefore single-valued. □ 

Proposition 2.8 Let m be a strictly positive integer, let (^)i^i^ m be reflexive real Banach spaces, and 
let 3L be the vector product space X ;= 1 .2f; equipped with the norm x = (x i ) 1 ^ i ^ m >-» \/ s £™ =l ||x ; || 2 . For 
every i G {1,..., m}, let / ; G r 0 (5Tj) be a Legendre function and let p t G T 0 (,!£)) be such that dom p t n 
intdom/i 7 ^ 0. Set f : 3L —»]-oo, + 00 ] : x <-* Xirli /i( x i) and P'- 3L —> ]— 00 ,+ 00 ] : x •-» XI^Li Vi( x i)- 
Then 

(Vx* = (x*)^^ m G X^ljint (dom/)' + dom p*)J Prox^x* = (Prox^.x*) (2.14) 

\y m 

Proof. First, we observe that 3L is the vector product space X i=1 . r £] equipped with the norm x = 

(x[) l^i^m l_> j ||x*|| 2 . Next, we derive from the definition of / that dom/ = X l= 1 dom/ and 

that 

m 

df:X^2 x *: (x ; )^^ m ~ X dff Xi ). (2.15) 

i=1 

Thus, df is single-valued on 

mm m 

dom df = X dom 3/ ; = X int dom/ ; = int f X dom/l = int dom/. (2.16) 

;=i t=i m=i J 


Likewise, since 

m 

/*:ar*-»]-«),+oo] YiKW’ 02.17) 

i=i 
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we deduce that df* is single-valued on dom df* = int dom/*. Consequently, [5, Theorems 5.4 and 5.6] 
assert that 

/ is a Legendre function. (2.18) 

In addition, 

mm m 

dom c p n int dom/ = ( X dom (p,-) n ( X int dom/,-) = X (dom (p ; n int dom/;) 0 . (2.19) 

v i= i J v i=1 J i=1 

Hence, Proposition 2.7(h)(b)&(ii)(c) assert that int(dom/* + dom(/?*) c domProx^, and Prox^, is 
single-valued on its domain. Now set x = Prox^x* and q = (Prox^. We derive from Proposi¬ 


tion 2.7(h) (a) that 

x = Prox^x* <=> x = (V/ + 3cp) - 1 (x*) <=> x* — V/(x) e 3(p(x). (2.20) 

Consequently, by invoking (1.4), we get 

(Vzedonup) (z — x,x* — V/(x)) + i/?(x) ip(z). (2.21) 

Upon setting z = q in (2.21), we obtain 

(q - x, x* - V/(x)) + i/?(x) ^ ip(q). (2.22) 

For every i e {1,..., m}, let us set q, = Prox^.x*. The same characterization as in (2.21) yields 

(Vi € {1,..., m})(Vz,- e dom (/?,-) (z ; - q h x* - V/j(q ; )) + i/? ; (q ; ) ^ ip;(z ; ). (2.23) 

By summing these inequalities over i e {1,..., m], we obtain 

(Vzedonup) (z - q,x* - V/(q)) + ip(q) ^ ip(z). (2.24) 

Upon setting z = x in (2.24), we get 

(x - q, V/(x) - V/(q)) + cp(q) ^ ip(x). (2.25) 

Adding (2.22) and (2.25) yields 

(x-q,V/(x)-V/(q)) ^ 0. (2.26) 

Now suppose that x 7 - q. Since /li nt dom/ is strictly convex, it follows from [28, Theorem 2.4.4(h)] that 
V/ is strictly monotone, i.e., 

(x —q,V/(x) —V/(q))> 0, (2.27) 

and we reach a contradiction. □ 


In Hilbert spaces, the operator defined in (2.8) reduces to the Moreau’s usual proximity operator 
prox^ [24] if / = || • || 2 /2. We provide illustrations of instances in the standard Euclidean space K m in 

which Prox^ is easier to evaluate than prox^. 
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Example 2.9 Let y e ]0, +oo[, let cp e T 0 (M) be such that dom cp n ] 0, +oo[ 7 ^ 0, and let ft be 
Boltzmann-Shannon entropy, i.e., 




ft: ?-» < 


0 , 

+ 00 , 


if £ e ] 0 , +oo[; 

if ? = 0; 

otherwise. 


(2.28) 


Set <p: (?i)r^ m -» $(£;) and / : (£i)i^m ^ 1 Note tha t / is a supercoercive Legen¬ 

dre function [4, Sections 5 and 6 ], and hence. Proposition 2.7(ii)(b) asserts that domProx^, = M m . Let 
e set = P rox rv(?i)i^i^m> let W be the Lambert function [19], i.e., the inverse 

of £ •—» on [0, +00 [, and let i e {1,..., m}. Then rp can be computed as follows. 


(i) Let co e M and suppose that 

l 


</>:£ 


£ln £-co£, if?e]0,+oc[; 

0 , if ? = 0 ; 

+ 00 , otherwise. 


Then rp = e^ i+ " tl/Cr+t) _ 

(ii) Let p e [l,+oo[ and suppose that either cp = | • | p /p or 


0 : 


Then 


f 


£ p /p 3 if £ € [ 0 ,+oo[; 
+ 00 , otherwise. 


f W(r(p-l)e ( f , “ 1)? 0V“ 1 


V 


D ?i-r 


r(p - 1 ) 


if p e ]l,+oo[; 
if p = 1 . 


(iii) Let p e [1, +00 [ and suppose that 

cp:^ 


? p /p, if ? e] 0 ,+oo[; 
+ 00 , otherwise. 


Then 


Vi = 


f w( r (p + i) e - ( p + 1 )? oV +1 




r(p + i) 


(2.29) 


(2.30) 


(2.31) 


(2.32) 


(2.33) 
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(iv) Let p e ] 0,1 [ and suppose that 

0:^ 

Then 


-£ p /p, if£e[0,+oo[; 

+oo, otherwise. 


(2.34) 


f W(p(l -p)e (p “ 1 )?i )V “ 1 

171 = I rO^-p) J ' 


(2.35) 


Example 2.10 Let 0 e T 0 (M) be such that dom i^n]O,l[^0 and let $ be Fermi-Dirac entropy, i.e., 


0 : £■ 


\ 


£ln£-(l-£)ln(l-£), if£e]0,l[; 
0 if?e{0,l}; 

+oo, otherwise. 


(2.36) 


Set ip: (£;)i<c is : m ^ Sill 0(£i) and / : (?i)i^rn S™i #(£;)• Note that / is a cofinite Legendre 
function [4, Sections 5 and 6], and hence Proposition 2.7(ii)(b) asserts that domProx^, = M m . Let 

(€iW«m e set = Prox i(?i)i«i^ m , and let i e {l,...,m}. Then rp can be computed as 

follows. 


(i) Let wel and suppose that 
( 


0 : ? 


<^ln^-to^, if £ e ]0,+oo[; 

0, if ? = 0; 

+oo, otherwise. 


(2.37) 


Then rp = —e^ i+a) x /2 + \]e 2 ^ i+w 1 V4 + e? i+ " k 
(ii) Suppose that 


0:?' 


/ 


V 


(l-?)ln(l-?) + ?, if£e]-oo,l[; 
1, if ? = 1; 

+oo, otherwise. 


(2.38) 


Thenrj ; = l+e ^ i /2 — \je &+e 2 ^/4. 

Example 2.11 Let / : (£;)i^i^m ■-» S;li 0(£;)> where 0 is Hellinger-like function, i.e., 
’-l/H 5 . if ?e[-l,l]; 


0 : £■ 


+oo, 


otherwise, 


(2.39) 


let y G ]0, +oo[, and let ip = f. Since / is a cofinite Legendre function [4, Sections 5 and 6], 


Proposition 2.7(ii)(b) asserts that domProx^ = M m . Let (£i)i<ci«j m 
Prox{ v (^ i ) 1 ^ m . Then (Vi e {1,..., m}) rp = £;/-y/(y + l) 2 + 


\ and set (p;)i 
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Example 2.12 Let y e ]0,+oo[, let cp e T 0 (R) be such that dom cp n ]0,+oo[ 7 ^ 0, and let $ be Burg 
entropy, i.e., 



-In if / e ] 0 ,+oo[; 

+ 00 , otherwise. 


(2.40) 



(i 7 i)i<cj«g m = Prox^,(^i)t^i^m- Let i e {1,..., m}. Then rj ; can be computed as follows. 

(i) Suppose that cp = ft and c >l e ]— 00, 0]. Then = —(1 + y)~ l E >i . 

(ii) Suppose that cp : / >— * a|/| and —00, ya\ . Then 17 , = (ya — £ ; ) _1 . 

The following result will be used subsequently. 

Lemma 2.13 Let 3C be a reflexive real Banach space, let f e T 0 (^r) be a Legendre function, let x e 
int dom/, and let (x n ) neN e (int dom/) N . Suppose that (D?(x, x n )) neN is bounded, that dom/* is open, 
and that V/* is weakly sequentially continuous. Then 2U(x n ) nsN c int dom/. 

Proof. [25, Proof of Theorem 4.1]. □ 


3 Forward-backward splitting in Banach spaces 

The first result in this section is a version of the forward-backward splitting algorithm in reflexive real 
Banach spaces which employs different Bregman distance-based proximity operators over the iterations. 

Theorem 3.1 Consider the setting of Problem 1.1 and let f e F 0 (3F) be a Legendre function such that 
Snintdom/ 7 ^ 0, L(int dom/) c intdorm/r, andf £= phpoL for some /3 e ]0, + 00 [. Let(q n ) nsP} e elm, 
let a e ]0,+oo[, and let (/„)„ eN be Legendre functions in 7 a (/) such that 


(Vne N) (1+ !?„)/„ ^fn+i- 


(3.1) 


Suppose that either — L*(ran Vi/>) c dom ip* or (Vn e N) f n is cofinite. Let e e ] 0, a/3/(a/3 + 1) [ and let 
(Tn)neN be a sequence in R such that 


(Vn e N) e sS y n sS a/3(l - e) and (1 + r?Jy n - y n+1 sS afr\ n . 


(3.2) 


Furthermore, let x 0 e int dom/ and iterate 


(Vn e N) x n+1 =Prox^ v (V/ n (x n )-y n L*V'0(LxJ). 


(3.3) 


Suppose in addition that (Vx e int dom/) D^(x,-) is coercive. Then (x n )„ sN is a bounded sequence in 
int dom/ and 2U(x n ) nsN c S. Moreover, there exists x e S such that the following hold. 
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(i) Suppose that § n dom/ is a singleton. Then x n —- x. 


(ii) Suppose that there exists g G 9“(/) such that for every n G N, g £= /„, and that, for every y 1 G 3T 
and every y 2 G ST, 


Ji e 2*J(* n)ne® 

• y 2 e 2»(x„) neN 


(3.4) 


=> Jl = Y2- 


l «yi-y2.V/ n (x n >»r n i*V‘0(Ix n ))) n6N converges 
In addition, suppose that one of the following holds. 

(a) Sc int dom/. 

(b) dom/* is open and V/* is weakly sequentially continuous. 

Then x n x. 

(iii) Suppose that f satisfies Condition 2.3 and that one of the following holds. 

(a) (p is uniformly convex at x. 

(b) ip is uniformly convex at L~x and there exists k g ]0, +oo[ such that (Vx G 3T) ||Lx|| ^ fc||x||. 

(c) HmDg (x n ) = 0 and there exists p G ]0, +oo[ such that (Vn G N) pf )= f n . 

Then x n —» x. 

Proof. We first derive from Proposition 2.7(ii)(c) that the operators (Prox{ ^) ne[ i are single-valued on 
their domains. We also note that Xq g int dom/. Suppose that x n G int dom/ for some n G N. If f n is 
cofinite then Proposition 2.7(h) (b) yields 


V/ n (x„) — y n L*Vt/(Lx n ) G 3T* = domProx^ 




n 


(3.5) 


Otherwise 


V'/„(x n ) - y n L*Vt/>(Lx n ) G int dom/ n * + y n domi/j* = int (int dom/ n * + p n dom(^*) 


c int (dom/ n * + y n dom <p*) = int (dom/ n * + dom (y„ </?*))• (3.6) 


Since int(dom/ n * + dom(y n (p*)) c domProx^ by Proposition 2.7(ii)(b), we deduce from (3.3), 
(3.5), (3.6), and Proposition 2.7(ii)(a) that x n+1 is a well-defined element in ranProx^ = domd(p n 
int dom/j = dom d ip n int dom/ c int dom/. By reasoning by induction, we conclude that 


(x„) neN G (int dom/) H is well-defined. 


(3.7) 


Next, let us set $ = tp + xp o L and 

(VnGN) g n : 3T —>]—oo, + 00 ] 



(3.8) 
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Since L(intdom/) c intdomi/j, it follows from (3.8) that (Vn € N) g n is Gateaux differentiable on 
dom g n = int domg n = int dom/. Since xp is continuous on int domt/.' D L(int dom/) and the functions 
On) are continuous on int dom/ [26, Proposition 3.3], we deduce that (Vn e N) g n is continuous 
on domg n . In addition, 

(Vn e N) g n -eaf = (1 -<?)(/„ - afiip °L) + e(/ n - a/)+ (a/3(l -e)-y n )ip °L. (3.9) 

Note that / 5 = fixp o L and (VneN)/„N/. Hence, (3.9) yields 

(Vn e N) f n )= a/3xp o L, (3.10) 

and hence, we deduce from (3.2) and (3.9) that (Vn eN)g„!= eaf. In turn, 

(Vn e N)(Vx e domg„)(Vy e domg„) (x - y, Vg„(x) - Vg n (y)) 

= D gn (x,y) + D Sn (y,x) ^ ea(D f (x, y) + D f (y, x)) 5? 0, (3.11) 

and it therefore follows from [28, Theorem 2.1.11] that (Vn € N) g n is convex. Consequently, 

(Vn e N) g n s9 ea (fl (3.12) 

Set co = 1 + 1/e. Then 

(Vn e N) (1 + mq n )g n - g n+1 = (1 + mrj n )(/„ - y n xp o L) - (/„ +1 - r n+1 t/> ° I) 

= (1 + Vn)fn - fn+1 + Vn^ 1 (/„ ~ (r« + eapty ° l) 

+ (a/rjn + Tn+1+ (3.13) 

We thus derive from (3.2) and (3.10) that 

(VneN) (l + o>T]„)g„ )= gn+i- (3.14) 

By invoking (3.3) and Proposition 2.7(h)(a), we get 

(VneN) V/ n (x n ) — y n L*Vt/>(Lx n ) e V/ n (x n+1 ) + y n d<p(x n+1 f (3.15) 

and therefore, 

(Vn e N) V/ n (x„) - y n L*V\p(Lx n ) e V/„(x n+1 ) - y n L*Vxp(Lx n+1 ) 

+ Yn( d V( x n+ 1 ) + L*V\p(Lx n+1 )). (3.16) 

Since [28, Theorem 2.4.2(vii)-(viii)] yield 

(VneN) d</>(x n+1 ) + L*ViKLx„ +1 ) c d<p(x„ +1 ) + L*(dip(Lx n+1 )) 

c d(ip + t/» °L)(x n+1 ) = 34>(x n+1 ), (3.17) 


we deduce from (3.16) that 

(Vn e N) Vg„(x„) - Vg n (x„ +1 ) e y n d4>(x n+1 ). 


(3.18) 
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By appealing to (1.4) and (3.18), we get 

(Vx € dom 4> n dom/)(Vn G N) y/ 1 (x - x n+1 , Vg„(x n ) - Vg n (x n+1 )) + 4>(x n+1 ) ^ 4>(x), (3.19) 


and hence, by [6, Proposition 2.3(ii], 

(Vx € dom<l> n dom/)(Vn G N) y/ 1 (D Sn (x, x n+1 ) + D g "(x n+1 ,x n ) - D 8n (x,x n )) 

+ 4>(x n+1 ) ^ $(x). (3.20) 

In particular, 

(Vx e S n dom/)(Vn G N) D s "(x,x n+1 ) + D Sn (x n+1 ,x n ) — D 8n (x,x n ) ^ 0. (3.21) 

By using (3.14), we deduce from (3.21) that 

(Vx e S n dom/)(Vn G N) D Sn+1 (x, x n+1 ) + (1 + cori n )D 8n (x n+1 , x n ) 

^ (1 + a>r) n )D Sn (x, x„), (3.22) 

and therefore, 

(Vx e § n dom/)(Vn G N) D Sn+1 (x,x n+1 ) ^ (1 + cor) n )D gn (x,x n ). (3.23) 

This shows that (x n )„ £N is stationarily quasi-Bregman monotone with respect to S relative to (g n )„ e[ i . 
Hence, we deduce from Proposition 2.4(h) that 

(x n ) neN G (int dom/) N is bounded (3.24) 

and, since is reflexive, 

StfOJ.eN 7^ 0- (3.25) 

In addition, we derive from (3.23) and Proposition 2.4(i) that 

(Vx G S n int dom/) (D 8n (x, x n )) neN converges, (3.26) 

and thus, since (3.22) yields 

(Vx G S n int dom/)(Vn G N) 0 ^ D 8n (x n+1 , x n ) 

^(l + cor] n )D fn (x n+ 1 ,x n ) 

^ (1 + cor] n )D fn (x, xj - D /n+1 (x, x n+1 ), (3.27) 

we obtain 

D 8n (x n+1 , x„) —» 0. (3.28) 

On the other hand, it follows from (3.12) that 

(VnGN) eaD f (x n+1 ,x n ) ^ D 8n (x n+1 ,x n ), (3.29) 
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and hence, (3.28) yields 
D f (x n+ i, x„) —» 0. 


(3.30) 


Now, it follows from (3.20) that 

(Vn e N) $(x„ +1 ) sS y/ 1 (D s "(x n , x n+1 ) + D g "(x n+1 , xj) + 4>(x n+1 ) $ $(x„), (3.31) 

which shows that (4>(x n )) n£N is decreasing and hence, since it is bounded from below by inf $(5f), it is 
convergent. However, (3.20) and (3.23) yield 

(Vx e S n int dom/)(Vn e N) 

e~ l ( —-D gn+1 (x, x n+1 ) + D g "(x n+1 , x„) - H ? "(x, x n ) ) + <f>(x n+1 ) 

^ 1 ( T~~ - D g *+'(x, x n+1 ) + £> s "(x n+1 , x n ) - D g "(x, x n ) ] + 4>(x n+1 ) 

V 1 "T ^*7n / 


$ <E>(x). (3.32) 

Since r) n —* 0, by taking the limit in (3.32) and then using (3.26) and (3.28), we get 

inf<l>(^') ^ lim<f>(x n ) ^ inf$(^T), (3.33) 

and thus, 

$(x„) -» inf $(JT). (3.34) 

We now show that 

2U(x n ) nsN C S. (3.35) 

To this end, suppose that x e 2U(x n ) nsN , i.e., x fc —* x. Since 4> is weakly lower semicontinuous [28, 
Theorem 2.2.1], by (3.34), 

inf 4>(iF) ^ 4>(x) ^ lim4>(x fcn ) = lim$(x n ) = inf4>(5T). (3.36) 

This yields 4>(x) = inf4>(^r), i.e., x e Argmin<l> = §. 


(i) : Let x e 2U(x n ) neN . Since (3.24) and (3.35) imply that 2U(x„) neN c S ndom/, we obtain 
2»OJneN = {x}, and in turn, (3.25) yields x n —- x. 

(ii) : In view of (3.35) and Proposition 2.5, it suffices to show that 2U(x n ) neN c int dom/. 

(ii)(a) : We have 2n(x n ) neN c S c int dom/. 

(ii) (b) : This follows from Lemma 2.13. 

(iii) : Let x e § n int dom/. Since / satisfies Condition 2.3, (3.30) yields 

x n+1 — x„ —> 0. (3.37) 
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Now set 


(VneN) z n = x n+1 and z* = y n 1 (Vg„(x„) - Vg n (z n )). (3.38) 

Then (3.18) and (3.37) imply that 

(VneN) z*e3$(z„) and z n — x n —> 0. (3.39) 

Since (3.22) yields 

(VnGN) D gn+1 (x,x n+1 ) = D gn+1 (x,z n ) 

^ (1+COVn) D8n (x> z n) 

= (1 +<^>Vn)D Sn (x,X n+1 ) 

^ (1 + coiq n )D 8n (x,x n ), (3.40) 

we deduce that 

(VriGN) (1 + co'i 7 n ) -1 D Sn+1 (x, x n+1 ) ^ D Sn {x,z n ) ^ D gn (x, x n ). (3.41) 

Altogether, (3.26) and (3.41) yield 

D g »(x,z n )-D g «(x,x n )^ 0. (3.42) 

In (3.19), by setting x = x, we get 

(VneN) 0 ^ y n (z n -x,z*) 

= (z n ~ Vg„(xJ - Vg n (zJ) 

= D gn (x, xj - D gn (x,z n ) - D gn (z n , x n ) 

^ D gn (x,x n ) - D gn (x,z n ). (3.43) 

By taking to the limit in (3.43) and using (3.42), we get 

(z n -x,z*)^0. (3.44) 

(iii) (a) : In this case S = {x}. Since cp is uniformly convex at x, 4> is likewise and hence, there exists 
an increasing function 0: [0, +oo[ —» [0, +oo] that vanishes only at 0 such that 

(Vne N)(Vt e ]0,1 [) 4>(tx + (1 - t) z„) + t( 1 - ir)0(||z n — x||) ^ t4>(x) + (1 - t)4>(z„). (3.45) 

It therefore follows from [28, Page 201] that 34> is uniformly monotone at x and its modulus of 
convexity is 0, i.e, 

(VneN) {z n -x,z*)2<K\\z n -x\\)2 0. (3.46) 

Altogether, (3.44) and (3.46) yield 0(||z n — x||) —» 0, and thus, z n —» x. In turn, (3.39) yields x n —* x. 
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(iii)(b): By the same argument as in (iii)(a), S = {x} and there exists an increasing function 
</>: [0, +oo [ —> [0, +oo] that vanishes only at 0 such that 

(VneN) (z n - x, Vip(Lz n ) - Vip(Lx) ^ <f>(\\Lz n - Lx||). (3.47) 

In turn, it follows from (3.17) and [28, Theorem 2.4.2(iv)] that 

(Vne N) (z n -x,z* n ) Z <t>(\\Lz n - Lx\\l (3.48) 

This yields /(||Lz n — Lx||) —» 0, and hence, Lz n —» Vx. Since 

(VneN) \\Lz n —Lx\\^ K\\z n — x\\, (3.49) 

we obtain z n — * x and in turn, (3.39) yields x n —» x. 

(iii)(c): First, we observe that S is closed and convex since <f> € r 0 (,+'). Next, for every n e IT, 
since pf >= f n , we derive from (3.8) that /i/ + g n . Finally, the strong convergence follows from 
Proposition 2.6. □ 

The following corollary of Theorem 3.1 appears to be the first version of the forward-backward 
algorithm outside of Hilbert spaces. 

Theorem 3.2 Consider the setting of Problem 1.1 and let f e F 0 (3C) be a Legendre function such that 
S n intdom/ 0, I(intdom/) c intdomif, and f $= /3xp o L for some e ]0,+oo[. Suppose that 
either f is cofinite or — L*(ranVtf) c domip*, and that (Vx e intdom/) D^(x, ■) is coercive. Let e e 
] 0, /3/(/3 + 1) [, let(p n ) neN e ^I(N), and let ( Y n ) n <=n be a sequence in M such that 

(VneN) e sS y n /3(1 - e) and (1 + rj n )y„ - y n+1 ^ fr\ n . (3.50) 

Furthermore, let x 0 e int dornf and iterate 

(VneN) x„ +1 =Prox^ v (V/(x n )-y n L*Vtf(Lx„)). (3.51) 

Then there exists x e S such that the following hold. 


(i) Suppose that one of the following holds. 

(a) S n dom/ is a singleton. 

(b) V/ and Vtf are weakly sequentially continuous and S c int dom/. 

(c) dom/* is open and V/, V/*, and Vtf are weakly sequentially continuous. 

Then x n —- x. 

(ii) Suppose that f satisfies Condition 2.3 and that one of the following holds. 

(a) p is uniformly convex at x. 

(b) ip is uniformly convex at Vx and there exists k e ]0, +oo[ such that (Vx e 3C) ||Lx|| ^ k||x 

(c) limD{(x n ) = 0. 
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Then x. 


x. 


Proof. Set (Vn e N)/„=/• Then 


(VneN) 


/.SOW), 

‘ f ^fn, 

t (l +Vn)fn tfn+l- 


(3.52) 


(i)(a): This is a corollary of Theorem 3.1 (i). 

(i)(b)-(i)(c): Firstly, the proof of Theorem 3.1(ii)(a)-(ii)(b) shows that 2B(x n ) neN c intdom/. 
Next, in view of Theorem 3.1(h), it suffices to show that (3.4) holds. To this end, suppose that y 1 and 


y 2 are two weak sequential cluster points of (x n ) neN such that 

((ji-y 2 ,V/(x n )-y n L*Vt/)(Lx n ))) neN converges. (3.53) 

Then, there exist two strictly increasing sequences (/< n )„ e[: and (/ )1 ), ie j; i in N such that x kn —- y 1 and 
x l n Yi- We derive from (3.50) and [27, Lemma 2.2.2] that there exists 6 e [s, /3(1 — e)] such that 
y n —» 6. Since V/ and Vip are weakly sequentially continuous, after taking the limit in (3.53) along 
the subsequences (x^ ) neN and (x; n )„ eN , respectively, we get 

(yi -J2>V/( yi )- 0L*V^(L yi )) = (yi -y 2 ,V/(y 2 )-0L*V^(Ly 2 )). (3.54) 

Let us define 

h: 3T —> ]—oo, +oo] 

f/(x) — Qxp(Lx), if xe intdom/; (3.55) 

x 1 —* f 

1 +oo, otherwise. 

Then h is Gateaux differentiable on intdom h = int dom/ and (3.54) yields 

(ji - T2> VKyi) - Vh(y 2 )) = 0. (3.56) 

On the other hand, 

h — ef = / — 6\p o L — ef = (1 — e)(/ - [3ip o L) + (/3(1 — e) — 9)ip o L. (3.57) 

In turn, since / )= /3xp o L and 0 /3( 1 — e), we obtain ef , and hence, 

D\yi,y 2 )* ! eD f (y 1} y 2 ) and D h (y 2 ,yi) 5? eD f (y 2 ,yi). (3.58) 

Therefore, (3.56) yields 

0 = (ji - J2» Vh(y a ) - Vh(y 2 )) 

= -D ,1 (yi.y2) + £,,, (y2,yi) 

^ e(L> / (yi,y 2 ) + ^ / (j2,yi)) 

= e(yi-y 2 »V/(y 1 )-V/(y 2 )). (3.59) 
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Suppose that y 1 ^ y 2 - Since /li nt dom/ is strictly convex, V/ is strictly monotone [28, Theo¬ 
rem 2.4.4(h)], i.e., 

<yi-y 2 .V/(y 1 )-V/(y 2 )) >0 (3.60) 

and we reach a contradiction. 

(ii): The conclusions follow from (3.52) and Theorem 3.1 (iii) . □ 

Remark 3.3 In Problem 1.1, suppose that L = Id. We rewrite algorithm (3.51) as follow 

(VneN) x n+1 = argmin (<p(x) + (x - x n , Vxp(x n )} + xp{x n ) + y~^D f (x, x n )\. (3.61) 

Another method to solve Problem 1.1 was proposed in [11]. In that method, instead of solving (3.61), 
the authors solve 

(VneN) x„ +1 = argmin (y(x) + (x - x n ,Vxp(x n )) + xp(x n ) + y^Wx - x n \\ p \ (3.62) 

xesc v ' 

for some 1 < p ^ 2. The weak convergence is established under the assumptions that Problem 1.1 
admits a unique solution, Vxp is (p — l)-Holder continuous with constant /3, and 0 < inf neN y n ^ 
sup„ £N y n ^ (1 —<5)//3, where 0 < 5 < 1. The high nonlinearity of the regularization in (3.62) compared 
to (3.61) makes the numerical implementation of this method difficult in general. Furthermore, since 
(3.62) yields 

(VneN) 0 e dip(x n+1 ) + Vxp(x n ) + (|]x n+1 -x n || p ), (3.63) 

and since (Vn e N) d (||x n+1 — xj]^) is not separable, this method is not a splitting method. 

Remark 3.4 We can reformulate Problem 1.1 as the following joint minimization problem 

minimize cp(x) + t/>(y), (3.64) 

0 ,y)ev 

where V = gra L = {(x, y ) e 3£ x ^ | y = Lx}. This constrained problem is equivalent to the following 
unconstrained problem 

minimize p(x) + t/)(y) + i, v (x,y). (3.65) 

(x,y)e3£x& 

In [9], a different coupling term between the variables x and y was considered and the problem 
considered there was 

minimize p(x) + xp(y) + D^(x,y), (3.66) 

(x,y)e3Cx'S/ 

in the Euclidean spaces. Their method activates cp and ip via their so-called left and right Bregman 
proximity operators alternatively (see also [7] for the projection setting). This method does not require 
the smoothness of xp but it requires the computation of Bregman distance-based proximity operator of 
xp. 
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Next, we provide a particular instance of Theorem 3.2 in finite-dimensional spaces. 

Corollary 3.5 In the setting of Problem 1.1, suppose that 3C and <3/ are finite-dimensional. Let f er 0 (ST) 
be a Legendre function such that § n int dom/ 0, L(int dom/) c int domt p, f 5 = flip 0 L for some 
/3 e ]0,+oo[, and dom/* is open. Suppose that either f is cofinite or —L*(vanVip) c dom(/?*. Let 
s e ] 0, /3/(/3 + 1) [, let (rj n ) nsN e fl(N), and let (y n ) ne jsj be a sequence in R such that 

(VneN) 1 - e) and (1 + rj n )y n - y n+1 ^/3rj n . (3.67) 

Furthermore, let x 0 e int dom/ and iterate 

(VneN) x n+1 =Prox^ v (V/(x n )-y n L*V-0(Lx n )). (3.68) 

Then there exists x e S such that x n —* x. 

Proof. Since dom/* is open, [5, Lemma 7.3(ix)] asserts that (Vx e int dom/) l/(x, ■) is coercive. 
Hence, the claim follows from Theorem 3.2(i) (c) . □ 

Remark 3.6 We provide some special cases of Problem 1.1 and Theorem 3.2. 

(i) Let I and K be totally ordered countable index sets. In Problem 1.1, suppose that 3F and 3/ are 
separable Hilbert spaces, and that ip: y •-» Xfcex K/ — r >Tfc) | 2 /2, where r£^ and (yiJkeK * s a 
frame in 3 /, i.e., 

(3(/r,v) e ]0,+oo[ 2 )(Vy e <&) ju||y|| 2 ^ |(y,y fc )| 2 ^ v||y|| 2 . (3.69) 

keK 

Then in Theorem 3.2, we can choose / : x > Xiez K x > x ;)l 2 /2, where (x ; ) !eJ is a frame in 3£, i.e., 
(3(a,/3) e ]0,+oo[ 2 )(Vx e X) a||x|| 2 ^ |(x,x ; )| 2 ^ ^||x|| 2 . (3.70) 

iel 

It follows from [16, Corollary 1] that / and ip are Legendre functions and that V/ and Vt p are 
weakly sequentially continuous. Now let x and z be in 3C. Then 

D^(Lx,Lz) = ^]|(Lx~ Lz,y fc )| 2 /2 ^ v||Lx - Lz|| 2 /2 

keK 

^ v\\L\\ 2 \\x -z|| 2 /2 ^ vlilpa-^Kx -*,x f )| 2 /2 

iel 

= v\\L\\ 2 a- 1 D^x,z), (3.71) 

which implies that / av _1 ||L||“ 2 t/> o L and in addition, D^(x, •) is coercive. 

(ii) Let p and q be in ]l,+oo[ and set p* = p/{p — 1) and q* = q(p — 1). In Problem 1.1, suppose 

that 3T = £ P (N) and 3/ = £ q (N), that r e ( 9 (N), that ip: y >-» ||y|| 9 /q — (y — r, ||r|| q ~ 2 r) — 

||r|| g /q, and that there exists k e ]0,+oo[ such that (Vx e £ P (N)) ||Lx|| ^ jc||x|[. It follows from 
[15, Theorem 4.7] that f p (N) is uniformly convex and hence, strictly convex. Therefore, ip is 
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strictly convex and supercoercive. The property of L implies that ip o L is strictly convex and 
supercoercive, and ip + ip o L is likewise. In turn, Problem 1.1 admits a unique solution. Let 
/ e T 0 (f p (N)) be a cofinite Legendre function such that / £= /3\\L ■ || p for some (3 e ]0, +oo[, let 
x e £ P (N), and set 

cp : [0, +oo[—* [0,+oo]: t —» inf (||x|| p —p(x-z, ||z|| p_2 z) - ||z|| p ). (3.72) 

||z-x||=t 

Then 

(Vze£ p (N)) D f {x,z)^p/3D^\Lx,Lz)^ /3cp(i\\Lz-Lx\\). (3.73) 

If p e [2, +oo[ then we derive from [12, Lemma 1.4.10] that 

(Vze( p (N)) cp(\\Lz — Lx||) ^ 2 1_p |[Lz — Lx|| p ^ 2 1 ~ p k p \\z — x|| p . (3.74) 


Thus, it follows from (3.73) that 


(Vz € f p (N)) D / (x,z)^2 1 “ p (c p /3||z-x|| p , (3.75) 

and D^(x, ■) is therefore coercive. If p e ] 1,2[ then we derive from [12, Lemma 1.4.8] that 

(Vz e ( p (N)) 0(||Lz - Lx ||) ^ (||Lz - Lx|| + ||Lz||) p - ||Lz|| p -p||LzP" 1 ||Lz - Lx||, (3.76) 


and hence, (3.73) yields 

(Vz € ( p (N)) Df(x,z ) 5? /3 (d|Lz|| + ||Lz - Lx ||) p - ||Lz|| p - pWLz ^- 1 \\Lz - Lx||) . 
On the other hand, since 

CIMI + I \Lz - Lx\) p - \\Lz\\p -pWLzWP-'WLz - Lx || _ i 
IMH+oo (2 P — 1 — p)||Lz|| p 

and since 2 P — 1 — p > 0, it follows from and (3.77) and the property of L that 

lim DMx,z) = + oo, 

11 * 11—*+00 

and D^(x, ■) is therefore coercive. Consequently, Theorem 3.2(i) (a) can be applied. 


(3.77) 


(3.78) 


(3.79) 


4 Application to multivariate minimization 


We propose a variant of the forward-backward algorithm to solve the following multivariate minimiza¬ 
tion problem. 


Problem 4.1 Let m and p be strictly positive integers, let (^i)i^i^m and (^c)i<;/c$p be reflexive real 
Banach spaces. For every i e {1,.. ,,m} and every k e {1,. ..,p}, let c p i e r 0 (5K;), let ip k e T 0 ( , 3^) be 
Gateaux differentiable on intdom-0 fc ^ 0, and let L ik : 3C t —* W k be linear and bounded. The problem 
is to 


minimize 



(4.1) 


Denote by S the set of solutions to (4.1). 
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We derive from Theorem 3.2 the following result. 


Proposition 4.2 Consider the setting of Problem 4 . 1 . For every k e { 1 ,... ,p}, suppose that there exists 
cr k e ]0,+oo[ such that for every (y;jOi$i^m e int domip k and every (Vi fc ) 1$ ^ m € intdom xp k satisfying 
SrLi Tifc e int domt p k and v ik e int domt p k , one has 

mm m 

(4 - 2) 

i=l i=l i=t 


For every i e { 1 , let /; e T 0 (^Tj) be a Legendre function such that (Vx; e intdom/;) D-'/x;, •) 

is coercive. For every k e { 1 ,... ,p}, suppose that L;fc(int dom/ ; ) c int domt/) fcj , that, /or every i e 
{1,..., m}, there exists fi ik e ]0, +oo[ such that /; £= Pik^Pk ° L;/o an> d set Pk = ntin^^ Pik■ addition, 
suppose that S n X i=1 int dom/; 7^ 0 and that either (Vi e {1,..., m}) /; is cofinite or (Vi e {1,..., m}) 
(^; is cofinite. Let e e ] 0,1/(1 + X!Li <J kP k 1 ) D ^ et C r ?n)ne n e and let (y n ) ne =N a sequence in ffi. 

such that 


(Vne N) 


e ^ r„ ^ 


( 4 . 3 ) 


Furthermore, let (*; o)i^i^m 


X i=1 int dom/; and iterate 


for n = 0,1,... 
for i = 1, ..., m 

X !,n+1 = Pr0X TnVi ( V /;(*i,J - 7n ZLl V ^/c ( H7=l L jk*j,n) ) • 

Then there exists (x i ) 1 ^;^ m e S such that the following hold. 


( 4 . 4 ) 


(i) Suppose that S n X i=1 dom/; is a singleton. Then (Vi € {1,..., m}) X; „ —- x ; . 

(ii) For every i e and eveiy k e {1,... ,p}, suppose that V/ ; and are weakly sequentially 

continuous, and that one of the following holds. 

(a) dom (/>; c int dom/;. 

(b) dom/ ; * is open and V/* is weakly sequentially continuous. 

Then (Vi m}) x i n x ; . 


Proof. Denote by iJT and ‘S/ the standard vector product spaces X; =1 5f; and xL j equipped with 
the norms x = (x i ) 1 ^;^ m >-» LZLi IWI 2 and y 1 * L2L7 ||y fc || 2 , respectively. Then 3F* 

is the vector product space X; =1 .3T* equipped with the norm x* >-» ||x*|| 2 and <$/* is the vector 

product space equipped with the norm y* *-» lly^ll 2 - Let us introduce the functions 

and operator 

(p- 3C ->]-oo,+oo] : x-»XLi iPi(Xi) 

J / : »] — 00 , + 00 ] : x —> XLi /i(x;) ^ 

ip: <& -»]- 00 , + 00 ] : y -» ^Lt '‘/’k(yfc) 

L: S —» ‘S/'. X > (2j[=l ^ik x i) l^k^p- 
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\yP 

Then xp is Gateaux differentiable on int domxp = X )c=1 intdomi p k and Problem 4.1 is a special case 
of Problem 1.1. Since (4.5) yields dom/* = X i=1 dom/7 and domcp* = X i=1 domcp*, we deduce 
from our assumptions that either / is cofinite or cp is cofinite. As in (2.18) and (2.19), / is a Legendre 
function and dom ip n int dom/ ^ 0. In addition, 

pm p 

L (int dom/) = X / L^/int dom/,) c X int domxp k = int domxp. (4.6) 

k=ii=i k=i 

Now let x e int dom/. First, to show that D^(x, •) is coercive, we fix p e M. On the one hand, 

m 

{z = (Zf)i^i^m € % I D f (x,z) ^ p} C X G I D-^X^Z;) ^ p}. (4.7) 

i=l 

On the other hand, for every i € {1,..., m}, since D^(x ; , ■) is coercive, we deduce that 

{zj e | D^(xi,Z;) ^ p} is bounded. (4.8) 

Hence (4.7) implies that {z e 3£ | D^(x, z) ^ p} is bounded and (x, •) is therefore coercive. Next, 
set /3 = l/^k =1 cr k (3 // We shall show that / /3xp o L. To this end, fix z = (zj) 1$ ^ m e int dom/. We 
have 

P ( m 171 

D^(Lx,Lz) = 

fc=i V i=i i=i 

p m 

fc=l 1=1 

p m 

< a k^ k lDfi <i x i,Zi) 

k=1 i=l 
P 

(x, z). (4.9) 

fc=i 

Now let us set (Vn £ N) x„ = ( x i,nhmm- By virtue of Proposition 2.8, (4.4) is a particular case of 
(3.51). 

(i) : Since S 0 dom/ is a singleton, the claim follows from Theorem 3.2(i)(a). 

(ii) : Our assumptions on (/;)i<c;^ m and (/'/Jiss/dSp imply that V/ and V/.' are weakly sequentially 
continuous. 

(ii) (a) : Since S c X ;=1 domipi c X i=1 intdom/, = int dom/, the claim follows from Theo¬ 
rem 3.2(i)(b). 

(ii) (b) : Since, for every i € {1,..., m}, dom/7 is open and V/ ; * is weakly sequentially continuous, 
we deduce that dom/* is open and V/* is weakly sequentially continuous. The assertion therefore 
follows from Theorem 3.2(i)(c). □ 
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Example 4.3 In Problem 4.1, suppose that m = 1, that 3Cy and ( < 3^k)i^k^p are Hilbert spaces, and 
that, for every k G {l,...,p}, p k = co k || • -r k || 2 /2, where (co fc )i^ p G ]0,+oo[ p and let (r fc ) laSfc<p € 
X k=1 & k . Then the weak convergence result in [17, Proposition 6.3] without errors is a particular 
instance of Proposition 4.2 with fy = || ■ || 2 /2. 


Example 4.4 Let m and p be strictly positive integers. For every ie{l,...,m} and every k G {1, ... ,p}, 
let co ik G ]0,+oo[, let g k G ]0,+oo[, and let ip t G T 0 (R) be cofinite. The problem is to 


m n s “ L + l - 1ln -+- 1 


(?1>— ,?m) e ]0.+ oo t ,r 


i—1 


fc=l 






Denote by S the set of solutions to (4.10) and suppose that § n ]0, +oo[ m ^ 0. Let 

, n ( — In £, if £>0; 

ti: M^]-oo,+oo] : £-» { S S 

1 +oo, otherwise 


(4.10) 


(4.11) 


be Burg entropy, let e G ] 0,1/(1 +p) [, let (rj n ) neN G f+(N), and let (y n ) n< =N be a sequence in R such 
that 


(Vn G N) e^Yn^P Hl-e) and (1 + rj n )y„ - Yn+i ^ P L Vn- 


-i„ 


Let (? i>0 ) 




]0,+oo[ m and iterate 


for n = 0,1,... 
for i = 1,..., m 

hn+l = PrOX r„ Vi I T~ ~Pnl W ifc| 


-1 




D; \ r i n —ik \ v-im r _ 

fc=l V Zj;=1 

Then there exists (Ci)i^i^m e § such that (Vi G {1,..., m}) n —» £ ; . 


(4.12) 


(4.13) 


Proof. For every i G {1,..., m} and every k G {1,... ,p}, let us set = R, 3^ = R, t/ij. = D fl (-, g k ), 
and L ik : E >1 >—» co ik ^ t . Then (4.10) is a particular case of (4.1). Since ip is not differentiable on IT, 
the standard forward-backward algorithm is inapplicable. We show that the problem can be solved by 
using Proposition 4.2. First, let (£;) y^i^. m and (i7;)i^i<; m be in ]0,+oo[ m , and consider 


1 P : 


] oo, + 00 ] : E, 


-ln£ + £-l, if ?G]0,+oo[; 


+ 00 , otherwise. 

We see that <p is convex and positive. Thus, 

'V m f.T f ™ n . F.\ JL L f ™ f F.' 

z_ii=l Si \ ± I ’ll Si \ v 1 1 1 1 Si \ ^ / Si 


(4.14) 


4> 


=* 2 


< 


Ei=iViJ V^iE j= iVjViJ til, j= yVj VViJ ti [Vi 1 


(4.15) 


and hence, 
-In 


Skii+Skii K vf_, 

SLu "§1 v, m . 


(4.16) 
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In turn, 


( m m \ m 

(4.17) 

i=l i=i J ;=i 

This shows that (4.2) is satisfied with (V/c € {1,... ,p}) a k = 1. Next, let us set (Vi e {1,..., m}) f = ft. 
Fix i S {l,...,m} and k S {1,...,p}, and let and r] ; be in ]0, +oo[. Then 

DHL ik Zu L ik Vi) = D\to ik ^ u co ikVi ) = D # (£, rp) = £*(£;, rp), (4.18) 

which implies that ip k ° L ik . In addition, since dom/ ; * = ]—oo,0[ is open, [5, Lemma 7.3(ix)] as¬ 
serts that D-' i (^ i , •) is coercive. We therefore deduce the convergence result from Proposition 4.2(h)(b). 

□ 


Example 4.5 Let m and p be strictly positive integers. For every i e {1, ..., m} and every fc e {1, ... ,p}, 
let co ik e ]0,+oo[, let g k e ]0,+oo[, and let e T 0 (M). The problem is to 


— rm S + S f f S 1 ln ^ - S + 


(?1>~ ,Cm) e [0>+°°[ m 


fc = l V V! = l 


Qk 


(4.19) 


! = 1 


Denote by S the set of solutions to (4.19) and suppose that S D ]0, + 00 [ m 7 ^ 0. Let 


0: 


]— 00 , + 00 ] : £ —* < 


V 


£ln?-£, if£e] 0 ,+oo[; 
0 , if <? = 0 ; 

+ 00 , otherwise 


(4.20) 


be Boltzmann-Shannon entropy, let /3 = max max co ik , let e e ] 0, 1/(1 + /3) [, let (p n )n £ pj e fi(N), 
and let (y„) ne N t> e a sequence in M such that 


(Vn e N) e sS r n =$ (p/3) H1 - e) and (1 + ft n )r n ~ Tn+i ^ (pP) 1 Vn- 

Let (?i j o)i$i^ m e ]0,+oo[ m and iterate 

for n = 0 ,1,... 
for i = 1. m 


(4.21) 


?U+1 = PrOX ? n ^ ( ln ?i,n - Tn E °>ik ( ^ ( EjLl ~ ^ Qk) ) • 


(4.22) 


Then there exists e § such that (Vi e {1,..., m}) n 


Proof. For every i e {1, ...,m} and every k e {l,...,p}, let us set 3P t = M, = M, r/> fc = D^(-,g k ), 
and L ik : E )i —» Then (4.19) is a particular case of (4.1). We cannot apply the standard forward- 

backward algorithm here since ip is not differentiable on E p . We shall verily the assumptions of Propo¬ 
sition 4.2. First, let (£;)i<g;and (i7;)is:iscm t> e in ]0,+oo[ m . Since 

[?ln£ if £e] 0 ,+oo[; 

cp : M * ] 00 , -Foo] : E> • > i 0, if £ = 0; (4.23) 

1 + 00 , otherwise 
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is convex, we have 


0 




m 

ZZLiWi) 


< 


Vi 


m 

i=i Zj/=i 'lj 


<t> 



and hence, 


vim £. , 

Skill Skli<v^^£ii 

zr=i * n sr=i tji " 6* su vj vt n * zr=i * 


In turn. 


m \ v^m v- m r 

*1,^, 

2-,i=iVi i =i 'ii 


V i=l > 

which implies that 


m m 


m m 


D 


91 


. i=i ;=i y V ;=i y 4 j;=i '/i i=i i=i 


< 


2(gihi--Ci + TJi 


i=l 


Vi 


Y^D^Vil 


i =1 


(4.24) 


(4.25) 


(4.26) 


(4.27) 


This shows that (4.2) is satisfied with (Vfc e {1,... ,p}) cr k = 1. Next, let us set (Vi e {1,..., m}) / ; = H. 
Fix i £ {l,...,m} and k e {1,...,p}, and let and rj; be in ]0, +oo[. Then 

DHL ik ^u L ik Vi ) = £> V;^;, co^) = rji) sS r| f ), (4.28) 

which implies that f t £= /3~ 1 xp k o L ifc . In addition, since f t is supercoercive, /) is cofinite and 
[5, Lemma 7.3(viii)] asserts that D^(E ,;, ■) is coercive. Therefore, the claim follows from Proposi¬ 
tion 4.2(ii)(b). □ 


Remark 4.6 The Bregman distance associated with Burg entropy, i.e., the Itakura-Saito divergence, is 
used in linear regression [3, Section 3]. The Bregman distance associated with Boltzmann-Shannon 
entropy, i.e., the Kullback-Leibler divergence, is used in information theory [3, Section 3] and image 
processing [13]. 


Acknowledgment. I would like to thank my doctoral advisor Professor Patrick L. Combettes for bring¬ 
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